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Ll. INTRODUCE 


A. - PURPOSE 

This study continues the work started by Major D.D. 
Tucker [Ref. 1] and continued by Major John R. Robinson 
[Ref. 2] in their respective theses submitted at the Naval 
Postgraduate School (NPS) in September 1985 and March 1986. 
Their works [Refs. 1,2] dealt with obtaining better attri- 
tion rate estimates for the Marine Corps officer manpower 
model than the ones currently in use. Both Tucker and 
Robinson in the "Recommendations" section of their theses 
[Ref. 1: p. 72] [Ref. 2: p. 69] stated that further work on 
how to update the estimates from year to year was needed. 
This study investigates this "yearly updating" problem. 

The primary purpose of this work is to investigate the 
efficacy of the exponential smoothing model as a yearly 
updating model for Marine Corps attrition rates. The reasons 
for choosing the exponential smoothing model for study are 
outlined in Chapter II. 

A secondary objective of this study will be to compare 
the performance of the attrition rate estimators introduced 
by Robinson [Ref. 2], which are introduced later in this 


chapter, to the current Marine Corps’ estimator. 


B. BACKGROUND 

Much of the background detail for this study is well- 
documented in previous works. Tucker [Ref. 1: pp. 15-38, 
128-138] explains the Marine Corps Officer attrition and 
promotion structure, the structure of the data base used by 
the Marine Corps in its officer planning process, the 
process itself, and how the data from the Navy Personnel 
Research and Development Center was transferred to the NPS 


computer system. Robinson's study [Ref. 2: pp. 11,14-20] 
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contains a complete summary of the estimation methods and 
aggregation procedure he used. For continuity, these estima- 
tion methods and this aggregation scheme are used in the 
present work. 

Robinson's thesis [Ref. 2: pp. 74-75] also includes an 
explanation of the Freeman-Tukey arcsine transformation, 
which is used to stabilize the variance of the empirical 
loss rate estimates. The empirical process is assumed to 


have a binomial(n,p) distribution with parameters 


central inventory for the year 


probability that an inventory unit leaves the 


Marine Corps during the year. 


The Freeman-Tukey arcsine transformation provides a second 
scale for comparison of the estimators within which the 
estimates have a more stable variance, and additionally, 
behave more like a normal distribution (see Appendix B). 
Both Tucker and Robinson [Refs. 1,2] used data from 
years 1977-1980 to obtain their loss rate estimates, and 
then used years 1981-1982 to validate them. Robinson 
[Ref. 2] also had year 1983 to use for validation of his 
estimates. Their estimates [Refs. 1,2] worked fairly well in 
predicting attrition one year into the future, but their 
success faded noticeably as the they tried to predict two or 
three years into the future. Thus there appears to be a 
time-varying component in the attrition rates. This leads 
to the problem of updating the loss rate estimates each year 


in order to better forecast future attrition. 


Gy PREVIOUS, WORK 

Major Tucker [Ref. 1] showed that the James-Stein 
shrinkage estimator was better than both the current method 
used by the Marine Corps and maximum likelihood estimators. 
He also showed that the James-Stein technique will provide 


estimates for those small cells which have no attrition, 
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i.e., those cells whose maximum likelihood estimator must 
be zero [Ref. 1]. Also, Tucker stated in his summary that 
the small inventory cells present a problem in loss rate 
estimation because "some of the cells are empty for struc- 
tural reasons while others are empty by chance" [Ref. 1: p. 
VCs 

Major Robinson [Ref. 2] tried to combat the "small cell" 
problem, i.e., the problem with estimating attrition rates 
for those cells with low inventory figures, by introducing 
the limited translation James-Stein technique of Efron and 
Morris [Refs. 3,4]. He showed that this technique improves 
upon the James-Stein estimates used by Tucker [Ref. 1] in 
estimating the rates for small cells [Ref. 2]. Robinson 
[Ref. 2] also introduced a transformed scale cell average 
(TSCA), an estimator corresponding to zero shrinkage in the 
James-Stein technique, which in many cases outperformed all 


other estimators. 


D. AGGREGATION METHOD 

The United States Marine Corps Officer Corps numbers 
approximately 20,000. Each officer below the rank of briga- 
dier general is cross-classified into one of 40 military 
occupational fields (OF), 31 lengths of service years (LOS), 
corresponding to O to 30 years in the Marine Corps, and 10 
grades, from warrant officer 1 to colonel, for a total of 
12,400 categories. 

Almost half (6149) of these categories, or cells, are 
"Structural zeroes" in inventory. "Structural zeroes" occur 
due to Marine Corps policy concerning promotions and because 
certain combinations of OF, LOS, and grade never occur, 
e.g., there are no colonels with just 2 years in service. 
These cells exist only in theory, not in practice, and are 
therefore not included in the feasible region of cells. 

A vast majority of the 6251 feasible cells are low 


inventory cells. Because of this, it is quite difficult to 
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obtain useful stable attrition rate estimates for these 
cells and it is wasteful to try to treat each cell astra 
ally. There is much communality of behavior among clusters 
of cells, and the grouping of cells into aggregates of like 
characteristics can ease the bookkeeping burden as well as 
provide the desired stability. Ideally, aggregation schemes 
can be found for which the aggregates ‘behave in a predic- 
table manner and for which meaningful conclusions may be 
drawn from statistical tests. However, current Marine Corps 
practice groups the cells according to organizational and 
operational considerations, producing aggregates that will 
not necessarily conform to any specific statistical 
behavior. 

H. Amin Elseramegy used the CART algorithm to find 
aggregations with predictable statistical behavior with 
encouraging results in his thesis submitted at NPS in 
December, 1985 [Ref. 5]. His results cannot be regarded as 
definitive because of operational considerations (e.g., 
excessive computer running time required some pre- 
aggregation), but can serve to guide future work. 


The current Marine Corps manpower model places all occu- 


pational fields into four categories: aviation (OF 72, 75), 
memodae sipport (OF 13,525, 35), ground combat (OF O3, O08, 
18) and other (includes 32 occupational fields). This 


aggregation scheme is used by both Tucker and Robinson 
[Refs. 1,2] and will be used again in the present work. For 
continuity, the aviation category will include only OF 75 as 
mermaid in both of their works [Refs. 1,2]. 


E. ESTIMATION METHODS 
Robinson in his thesis [Ref. 2] compared six loss rate 
estimators. These estimators are: 


1) Original Aggregate (AGG ORIG) -- the current. Marine 
Corps estimation method. The occupational fields are 
Place neo Chee foul Gategories —mentioned in the 
Pecos ng Sec HOM Fast detnwehommrates £rom 1977 to 

he present are supiecti ely weighted and averaged for 
each aggregate. e grand mean of the weighted 


nS 


2) 


3) 


4) 


>) 


6) 


attrition rates _ serves as the loss rate estimate for 
all cells (Ob Ges, Gee! Within the a Jie tees Both 

eee and Robinson [Refs. 1,2] found methods superior 
O 1s one. 


Transformed Jap Sdalee (AGG TRANS) -= Computed aE, 
transforming the empirical attrition rates using “the 
Freeman-Tukey equation and then calculating the meu, 
of the transformed values within each aggregate. This 
is followed by an inversion to the original Seale 
Again, this 1s a single number used» fer alll Weelie 
within the aggregate. 


Maximum Likelihood Estimator (MLE) -- Is_ calculated by 
summing all leavers (over time) ina cell and dividing 
by the total cell @toaveneer ae oven. time for the 
See taper eee This estimator is the MLE f£enmimae 
binomial istribution described in the previee. 
section. There are problems with using the MLE in this 
setting. While the estimate is indeed unbiased, it is 
unstable due to the abundance of small cells ‘calisinmg 
the poset ey of a wide range of values. Also, this 
MLE assumes that each year represents an identical 
CO while the data shows that a cell's 
ehavior can change drastically within a few years’ 
time. A complete discussion of the problems with using 
the MLE can be found in [Ref. 2: pp. 17-18]. 


Transformed Scale Cell PS TAgS (TSCA) -- scomputedias 
transforming the cell inventory an eS.S ata an 
calculating the time average for each cell over the 
estimation period. Inversion of the results provides 
attrition estimates in the original scale. Use of the 
Freeman-Tukey transform holds down the variability of 


this estimator, which was mentioned above as a 
pie econ ta Of MEE eos estimate performed 
surprisingly well in Robinson s analysis [Ref. 2]. 


James-Stein Estimator (JS) -- operates from the basic 
notion that by "shrinking" estimates toward the grand 
mean, the size of the sum of squared residual errors 
will be lessened. The shrinking 1s_ applied to the TSCA 
estimator. An optimal shrinkage factor is found for 
each aggregate, and the cell means are shrunk toward 
Che grand mean by that amount. See Figure 1.i. | ihe 
optimal shrinkage factors used here are those found by 
Robinson in his thesis [Ref. 2: pp. 34-36]. Notice 
that since the shrinkage 1s done in transformed space, 
the assumptions of normality and stable variance 
required by James-Stein are less compromised. 


Jima ted brans lavvoneddtece. te cam ee intuitaveRy 
it does not seem quite right to shrink all of the 
values towards the grand mean. After all, extreme 
values do occur occasionally, and their effects should 
be represented in an analysis of the data. This 
estimator deals with nis (pee keng b> limiting @eee 
translation of extreme values toward the grand mean. 
From Figure 1.2 one sees that there is an interval 
about. the grand mean within which £u0) Jawes-seewn 
shrinkage occurs, while outside this interval, the 
shrinkage is diminished. There is a factor, d, which 
controls the width of Ehwo inter late cb>insem (Ref. 2: 

-37) found the optimal values for this factor, and 
NY are used in the present work, For a, detailed 
explanation of this estimator, see Robinson s thesis 
{Ref. 2: pp22-25 
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Exponential smoothing provides a valid yearly updating 
model for the Marine Corps attrition rates in all cases. 
The estimates produced by exponential smoothing are, more 
often than not, better than those produced by the methods of 
Robinson [Ref. 2], and require far less data. This model 
shows its extreme flexibility by pointing out an external 
change in the aviation environment that occurred in 1981 and 
actually outperforms the Robinson estimates for tnis aggre- 
gate. 

In this study, as in Robinson's [Ref. 2], the TSCA, JS, 
and LTJS estimators forecast attrition rates better than the 
current method used by the Marine Corps. The maximum likeli- 
hood estimator performs well in the transformed scale, but 
has extremely large errors in original scale in some cases. 
This is due, in part, to the unsuitability in these cases of 
using the optimal smoothing constant values for transformed 
scale to produce smoothed estimates in original scale for 
this estimate (see Appendix C). However, as in Robinson's 
work [Ref. 2], no estimation method emerges as the clear-cut 
"best" choice. 

The ability of exponential smoothing to update attrition 
rates 1s encouraging. However, having studied such a limited 
sample of data, we believe that its implementation should be 
delayed until further studies can be done when more data 


becomes available. 
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tl. YEARLY UPDATING MERAODS 


A. GENERAL 

A yearly updating model is one which allows newly 
received data to be combined with data from the past to 
update the estimate produced by that past data. By updating 
the estimate, forecasts produced by the prior estimate 


Should be improved upon. 


B. CRITERIA FOR MODEL SELECTION 

There are many methods available to update parameter 
estimates, such as attrition rates, as more data becomes 
available. To choose among these methods, Robert Goodell 
Brown [Ref. 6] suggests using the following criteria: accu- 
racy, simplicity of computation, and flexibility of ratemer 
response. Of the three, only simplicity of computation is 
not a major concern for the yearly updating model. In 1963, 
when Brown published his book, simplicity of computation was 
important for a model because of the relative inefficiency 
of computers of that time as compared with those of today. 
Since today's computers are millions of times faster, we 
will not be concerned with this criterion in our model 
selection. However, a criterion which is important in 
choosing a yearly updating model is the amount of data that 
needs to be stored in order to produce the estimates. 

Naturally there are other criteria which may be used to 
select a parameter estimation model. However, the three that 
seem most appropriate in determining the yearly updating 
model used in this study are: 

1) accuracy 
2) size of data 


3) flexibility of rate of response 
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1. Accuracy 
Fulfilling the Marine Corps’ need for more accurate 


attrition rate estimates is one of the primary purposes of 
this pilot study. More accurate forecasts are produced by 
such estimates, thereby avoiding some of the costly overages 
and underages in inventory which result from the use of the 
current estimation system. 

One of the purposes of finding a yearly updating 
model is to improve upon the forecasts of Tucker and 
Robinson {Refs. 1,2], for which accuracy dropped off sharply 
after the first year. The yearly updating model selected 
should be able to forecast attrition rates one year in 
advance at least as well as Tucker and Robinson's 
[Refs. 1,2] did, and also improve greatly upon forecasting 
rates two or three years from the present. | 

In reality, it is the estimation of attrition rates 
two years from the time of the most recent data that should 
be of major concern. Loss and inventory data for a fiscal 
year is not generally available until halfway through the 
following fiscal year. Therefore, with the data available, 
the next time period in which attrition rates need to be 
forecasted is the year following the year in which the data 
is received, which is two years ahead of the most current 
available data. Thus the accuracy of the estimates for two 
years from the time of the most current data, for which 
Tucker and Robinson [Refs. 1,2] had little success, is one 
of the key figures with which the yearly updating model need 
be concerned. 

2. Size of Data 

This criterion is very important in choosing a 
yearly updating model. With 6251 feasible cells, it becomes 
unwieldy and costly in terms of computer storage space to 
log year after year of loss and inventory data. Thus, a 
model is sought which can use short summaries of the data 


and still produce valuable estimates. 
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Se Flexibility to the Rate of Response 
In forecasting, when the current observation is 


different from the forecasted value, there are two possible 
explanations: random fluctuation; change in the pattern of 
the data. If the error is a random fluctuation in the data, 
then the forecasting technique should smooth out the fluctu- 
ation. In order for the model to do this, it should produce 
estimates based on a great deal of past data. However, if 
the error is due to a change in the pattern of the data, 
then past data is rendered irrelevant. The estimate should 
reflect only the recent processes. 

Changes in Marine Corps policies in handling its 
officer corps, which occur from time to time, often cause 
corresponding changes in attrition patterns. Given informa- 
tion about such changes, one should be able to detect a new 
pattern in the loss and/or inventory data resulting from 
them. Thus, we want our yearly updating model to be able to 
smooth out random fluctuations in the data during times when 
the attrition process is stable over a period of years, yet 
still be able to respond rapidly to new conditions. The 
model must be able to easily adjust the number and relative 
value of past observations in producing the estimate, using 
a fairly long series of data for an unchanging process and 
only the most recent observations when a change in the 


DPrecess OCCUES. 


C. SELECTION OF THE YEARLY UPDATING MODEL 
1. Candidate One -- Tucker/Robinson's Methods 

Both Tucker and Robinson [Refs. 1,2] showed that the 
alternate estimators they introduced outperform the aggre- 
gation methods currently employed by the Marine Corps. They 
used four equally weighted years of data, 1977-1980, to 
produce their estimates [Refs. 1,2]. The question that 
arises from their findings is why not use the functions that 
Tucker and Robinson wrote [Refs. 1,2] to compute estimates 


based on five, six, seven, etc., years of data? 
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The answer to this question lies in the criteria for 
model selection outlined in the previous section, of which 
the continuing use of Tucker and Robinson's methods over 
time meet none. The accuracy of Tucker and Robinson's esti- 
mates [Refs. 1,2] dropped off sharply after the first year 
in most cases, and the estimate of attrition two years off 
is very important, as mentioned earlier. The amount of data 
used to produce their four-year estimates was tremendous; 
storing all of that data plus that of additional years would 
be totally inefficient. Finally, using their methods with 
more data is not responsive to changes in attrition 
patterns. Old data, equally weighted with recent data and 
which may no longer be relevant, is used in this technique 
to produce the loss rate estimates. 

Therefore, using Tucker and Robinson's methods 
[Refs. 1,2] year after year on all of the data available 
since 1977 is not a very good alternative. However, their 
methods are valuable for providing a base estimate for the 
exponential smoothing model to be discussed later. 

Zz. Candidate Two -- Moving Average 

A moving average 1s simply the sum of the most 
recent N observations divided by N. For example, imagine 
that a basketball player scores 18, 15, 25, 22, 20, and 14 
points in his first six games of the season. Let the scores 
be denoted by XG, i | ee. so 68 His scoring average is the 
sum of these six scores divided by six, or 19.0 points per 
game. Call this Me. suppose he scores 24 points in his 
seventh game. Then, if the practice of finding his scoring 
average over the past six games is continued, his six-game 
moving average, Mo, aon be computed by adding the scores 
from the most recent six games and dividing by six. Another 
way would be to subtract 1/6 of the score he achieved six 
games ago, or game one, and adding 1/6 of his total for the 
most recent game, game seven. This produces the six-game 


moving average 


Zi 


Ms = Mg + (X7-x1)/N 
19. Out (24-1806 =aomor 


Using this procedure to find attrition rates would 
be straightforward; one would just find the actual rates for 
the past N years and average them. This method does away 
with some of the problems with data size encountered wie 
the previous candidate. Whereas continued use of Tucker and 
Robinson's methods [Refs. 1,2] required the storage of all 
of the inventory and loss data from 1977 forward, this model 
will compute the rates each year for aggregates of cells, 
and only these rates, which number N times the number of 
aggregates, need be stored. This method may also prove to 
be more accurate than the continual use of Tucker and 
Robinson's methods [Refs. 1,2} since data from more thane 
years ago, which may bear little resemblance to current 
data, is eliminated. However, it is difficult to change the 
rate of response using a moving average. If a change in the 
underlying distribution of the data occurs, it will take N 
years for the moving average to fully reflect this change. 
One might suggest to keep N small so that it will respond 
more quickly to changes, but by doing this, the greater 
accuracy produced by larger data sets is sacrificed. Thus, 
N must be chosen so as to compromise between these 
conflicting objectives. 

The moving average 1S an improvement over the 
previous candidate, but it requires more data and 1s not as 
flexible as the candidate which follows, the exponential 
smoothing model. However, an understanding of it is helpful, 
as the exponential smoothing model is itself a type of 
moving average. 

3. Candidate Three -- Exponential Smoothing 

It is a disadvantage of the moving average that it 

has to carry all of the rates needed to compute it, albeit 


is a great improvement over the amount needed for the 
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continued use of Tucker and Robinson's methods [Refs. 1,2]. 
Exponential smoothing cuts back even further on the amount 
of data needed. Let us see how by continuing the example of 
the previous subsection. 

Suppose now that after recording the 24 points 
scored by the basketball player in game seven, it is discov- 
ered that all records of the previous six scores have been 
destroyed, but the moving average, Ne Ores til] remains. 
If the value of x, was known, M4 could be computed. The best 
estimate we have for x, is that is was equal to the average, 
i > 19.0. Using this estimate for X1, a new estimate of the 


six-game scoring average can be computed: 


Mhat~ — Me a 3 (x7 alien © 
(1/6)x_ + (5/6)Mg = 19.833 


Mhat4 is an estimate of the moving average Mo, and 
is called the smoothed value of the average. Mhat; will 
emedeber be referred to as 53, 3S standing for {smoothing. " 

If the equation used to find Mhat- a7 is used to 
find each succesive estimate, the definition of the smoothed 


Pumection of the observations is [Ref. 6: p. 101]: 
S;( x) eee (1-a@)S,_4(%) Ce) 


Miemsncomhing constant, @, is Similar, but not exactly equal 
to the fraction 1/N used to find the moving average [Ref. 6: 
p. 101]. The operation which updates an estimate by adding 
a fraction @ of the difference between the current observa- 
tion and the previous estimate to that previous estimate is 
called exponential smoothing [Ref. 6: p. 101]. 

Exponential smoothing discounts past data based upon 
the size of the @ parameter. How it does so can be seen by 
substituting for the previous smoothed value the equation 
that produced it from an even earlier smoothed value 
[Ref. A: p. 101): 
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S,(%) = @ x, FM( 1-0)CG ace ee) creme) (@e2) 

@ x,+ G (1-4)(Xe_1) + @ (1-a)4 xL_> +... 

aD (1-a)¥(xp4) + (1-4) S0( x) 

Thus, if the smoothing constant equals .2, then the 


current data point has weight .2. Previous observations 
have weights .16, .128, .1024, etc.. 

It is seen from the above equations that exponential 
smoothing always requires a prior estimate, eae to perioum 
the update and find S,. Brown {Ref. 6: p. 102] suggeae 
using the simple average of the most recent N observations, 
OT ee for the initial value St-]- In this study, the 
prior estimates are found in a similar manner. The functions 
developed by Tucker and Robinson [Refs. 1,2] and spelled out 
in detail in Robinson's thesis [Ref. 2: pp. 83-110] are used 
to find the estimates over N years of data. An optimal base 
estimate length N will be found for each aggregate using the 
data available. However, so that the results of this study 
may be compared with those of Robinson [Ref. 2], 3-year base 
estimates, corresponding to years 1977-1979, will be used. 
The empirical rates for 1980 are smoothed onto the base 
estimates to produce the updated estimates which can be 
validated on years 1981-1983 just as Robinson's estimates 
were [Ref. 2]. 

The exponential smoothing model best meets’ the 
criteria outlined in the previous section. It requires very 
little data to be carried from year to year as compared with 
the other candidates examined; only the last estimates 
obtained by the model need be saved. It is also very flex- 
ible to changes in the pattern of the data. When the 
smoothing constant is small, the function behaves like the 
average of a great deal of past data, whereas large values 
of the smoothing constant allow S(x) to respond quickly to 
changes in the attrition rate process [Ref. 6: p. 102]. Its 


accuracy should be greater than that of the moving average, 
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where the data is equally weighted, since exponential 
smoothing discounts past data. This will allow for more 
recent data to exert greater influence on the estimate, 
which is desirable because the near past generally repre- 
sents the near future better than the distant past. 
Therefore, since it fulfills the criteria better 
than all other candidates examined, exponential smoothing is 


the yearly updating model used in this work. 
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III. EXPONENTIAL SMOOTHING 


A. GENERAL 

Having chosen exponential smoothing for the model to 
update the attrition rates annually, the next step is to 
implement it. The exponential smoothing itself will be 
performed in transformed scale because the variances of the 
estimates are more stable in this scale. Therefore, both the 
base estimates S521(%) and observations x:., which are needed 
to produce the updated estimate Sj;(x), will be calculated in 
the transformed scale. 

When the loss data is collected by the Navy Personnel 
Research and Development Center, the cell (OF, LOS, grade) 
into which a loss is assigned is the cell to which the 
leaving officer belongs at his time of departure. For 
example, a first lieutenant with 3 years of service at the 
beginning of year i who completes his 4th year of service, 
1s promoted to captain, and subsequently leaves the service 
before the beginning of year itl is classified as a loss 
from LOS 4 years in his OF and the grade of CAPT in year i. 
This type of loss classification demands the use of central 
inventory data [Ref. 7: p. 25]. For data grouped by years, 
like the Marine Corps manpower data we have, central inven- 
tory for year i is found by averaging beginning-of-year i 
stocks with beginning-of-year itl stocks for each cell. ia 
beginning-of-year itl stocks are not available, because we 
are at the end of the data set or for whatever reason, the 
central inventory for year iis set equal to the beginning- 
of-year stocks for year i. This occurs in our data for year 
1983, since 1984 is not available for our use. Additionally, 
if losses in year i are greater than the central inventory 
of year i, the central inventory is set equal to the losses 


to avoid the apparent inconsistency of losing more men than 
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you have on hand. Thus, in the above example, the officer 
would have been counted as a 1LT in his OF with 3 years of 
service in the inventory for the beginning of year i. The 
attrition rate computed then, 12s the central attrition 
rate, which is the number of losses in year 1 divided by 


eemeral inventory for year i> {Ref. 7: p. 25]: 


The raw data compiled by the Navy Personnel Research and 
Development Center consists of losses and beginning-of-year 
inventories hos the 12400 cells mentioned a the 
Introduction chapter. Both Major Tucker and Major Robinson 
{Refs. 1,2] aggregated this data into the four categories 
react On eon 7/5)" combat’ suppor’ (OF I137 25,735), ground 
combat (OF O3, O08, 18), and other. The central inventory 
matrices were computed and the loss matrices compiled for 
the aviation, combat support, and ground combat aggregates 
for all years available (1977-1983 for Robinson and this 
work). The ‘other’ category was not examined by Tucker nor 
Robinson, nor will it be here. The best summary of the data 
manipulation programs producing the central inventory and 
loss matrices is found in Appendix D of Major Robinson's 
thesis [Ref. 2: pp. 83-104]. In order to be consistent with 
the analyses done in those two works, only the grades of 
first lieutenant (1LT) and lieutenant colonel (LTCOL) will 
be examined in this pilot study. Like Tucker and Robinson 
[Refs. 1,2], all 31 possible lengths of service years will 
be included. Additionally, all six estimators explored by 
Robinson [Ref. 2] and discussed in the Introduction chapter 
of this study will undergo exponential smoothing and have 
their forecasting abilities compared. Thus the total number 
of loss rate estimates that will ultimately be computed is 


25284, corresponding to 6 estimators, 7 operational fields, 
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31 lengths Of service Janda wo lade: The analysis will be 
broken down by grade and aggregate, as in Tucker and 
Robinson's works [Refs. 1,2], thereby setting up 6 study 
blocks: 

1) AViaticonelEts 

2) Aviation LTCOLS 

3) Combat Suppore Tire 

4) Combat Support LTCOLS 

5) Ground, Conbarwiuae 

6) Ground Combat Eicekoe. 

The base estimate S,_, and empirical estimate x, are 
found for all six estimates, 31 lengths of service, and 
occupational fields within a study block by using APL func- 
tion ESTIM (see Figure A.3), developed by Major Robinson 
(Ref. 2: pe 10sSie The updated estimate, still in trans- 
formed scale, is found by applying exponential smoothing 
equation 2.1 presented in the preceding chapter. The 
predicted rates are then validated against actual trans- 
formed figures from the years that follow. How this is done 


1s the subject of the next section. 


B..’. FIGURES  @be ERG 

The figures of merit (FOM) used by Robinson in his 
thesis [Ref. 2] will also be used here. The basis for the 
decisions concerning the finding of the optimal smoothing 
constants and base period lengths will be the figuivesiieces 
merit in transformed scale because the data is so much more 
well-behaved therein. The original scale figures of merit 
will also be calculated and reported in Chapter IV. The 
values of @ used to calculate the original scale figures of 
merit will be the optimal values of @ found in transformed 
scale. 

We would hope, therefore, that the value of the 
smoothing constant, @, corresponding to the smallest figure 


of merit in transformed scale 1s very close to that 
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corresponding to the smallest FOM in original § scale. 
Fortunately, this is almost always the case. Two exceptions 
are the transformed aggregate estimators for aviation I1LTS 
and ground combat 1LTS, which turn out not to be very 
important due to the overall lackluster performance the 
transformed aggregate estimator turns in throughout the 
analyses. More notably, however, the MLE for combat support 
1LTS, ground combat I1LTS, and ground combat LTCOLS have 
serious discrepancies between values of @ producing minimum 
figures of merit in transformed and original scales. These 
differences cast serious doubts upon the correctness of 
using the transformed scale optimal @ as the @ value in the 
Original scale for maximum 1ikelihood estimation. See 
Appendix C for the details of this analysis. 

In transformed scale, the data 1s approximately distrib- 
uted normally with a stable variance (see Appendix B). Thus, 
a good means of comparison between estimators is a sum of 
squares error (SSE) computation. The sum of squares error is 


defined as: 
aN . 2 
SSE = ) (actual-predicted) (23:2, ) 


where "actual" and "predicted" are the actual and predicted 
values for the transformed attrition rate figures for one of 
the validation years (VY). APL function RISKT calculates 
the figures of merit for transformed scale using the above 
equation (see Figure A.9). 

The original scale does not have a normal distribution 
nor a stable variance for the estimates. The SSE would 
therefore be inappropriate for the FOM calculations in orig- 
inal scale. Robinson [Ref. 2: p. 28] sugggested the use of a 
chi-square statistic for use to compare estimators in orig- 


inal scale. The chi-square statistic is: 
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FOM(t) = Y (vue-Nj¢P;)-/7le peta =p, ), for alien comer 


where yj; and N,, are the losses and central inventory 
counts for the it? cell in the t*? validation year, and p; 
CDeweerel 


calculated in transformed scale (see Appendix B). APL func- 


is the inverse transform of the estimate for the i 


tion RISKO (see Figure A.8), which computes the original 
scale figures of merit, screens out cells with Pj values of 
O and 1 to prevent the above denominator from having a value 
of zero. Both RISKI and RISKO find the figures of menijewec: 
all of the validation years available. 

With both of these figures of merit, the smaller the 
FOM, the better the estimates produced. Figures of merit are 
summed over all of the operational fields and lengths of 
service within a study block, thereby producing a single 


number for necessary comparisons. 


C. FINDING THE SMOOTHING CONSTANTS 

As mentioned in the preceding paragraph, it is the 
smallest figure of merit which we seek. Therefore, the 
smoothing constant, @, which produces the smallest FOM for 
an estimator is the optimum @ for that estimator. 

In order for the weighting scheme implied by exponential 
smoothing to make sense, @ must be between O and 1 inclu- 
sive. An estimate with a value of @ equal to O places no 
weight on the current empirical data point and all of the 
weight on the previous estimate; thus, this value is simply 
the estimate produced by Robinson [Ref. 2]. Conversely, an 
estimate produced with a value of @ = 1 is simply the empir- 
ical estimate from the most recent year's data. 

An APL function was developed to produce the figures of 
merit in both transformed and original scale for all valida- 
tion years available and all six estimators for a study 
block for all values of alpha between O and 1 by a specified 


step size, which in this study is .Od2. This functirem 
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ALPHAHAT, calculates the base estimates using function 
ESTIM, the empirical data points using function XFOUR (for a 
three-year base; XFIVE and XSIX for four- and five-year 
bases), which calls ESTIM, and smooths them into the new 
estimates using equation 2.1. See Appendix A. Arrays of 
figures of merit are produced, which can then be analyzed 


and the optimum @ found for each estimator and study block. 


Pe GENGTH OF BASE PERIOD 

The length of the base period is important in producing 
the loss rate estimates. If the environment is stable over a 
long period of time, a long base period is preferred to 
smooth out random fluctuations in the data. If the environ- 
ment is in a constant state of turmoil, the base period 
length should be rather small, and frequent updates of the 
base are needed. 

To provide a basis for comparison with the results 
obtained by Robinson [Ref. 2], a three-year base will be 
used in this study, with the fourth year empirical data 
smoothed onto it to produce the attrition rate estimates. 
Thus, years 1977-1980 are used for computation of the esti- 
mates, and years 1981-1983 are used for validation, as in 
Robinson's work [Ref. 2]. 

It should be noted that the choice of three years as the 
length of the base period may not be "optimal," that is, it 
may not provide estimates as accurate as those of a four- or 
five-year base period. Therefore, a short comparison of base 
estimate lengths three, four, and five years is presented 
below. The MOE used is transformed FOM for forecasted rates 
for validation year one. Although we are more concerned with 
the estimators' ability to estimate rates two years in 
advance, this MOE is chosen so that a 5-year base, which can 
only forecast for 1983, may be included. 

To find the figures of merit, the optimal @, which is 
the value of @ producing the smallest FOM for validation 


Se 


year one, is found for each base year length and study 
block. The resulting figures of merit are then compared to 
determine the "best" base period length for an aggregate. 

It should be noted that with the limited number of data 
years we have to work with, the conclusions drawn by this 
short analysis cannot be generalized to future years. The 
length of base period problem should be examined in more 


detail as more data becomes available. 


TABLE 1 
DETERMINATION OF OPTIMAL BASE PERIOD -=- COMBAT SUPPORT 
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ae Combat Support 
Interestingly,' there is an increase in the minimum 


FOM from a three- to a four-year base, with the five-year 
base minimum FOM being smaller than both of them for the 
TSCA, JS, and LTJS estimators for both grades, as well as 
AGG TRANS and MLE 1LTS. The other 4 estimator-grade combina- 


tions show a strictly decreasing trend across all 3 base 
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penvodmengths. = Thusy from Table 1, it appears that a 5-year 
base would be best to use for the combat support aggregate, 
Since all transformed figures of merit are smallest for this 


base period length. 


TABLE 2 
DETERMINATION OF OPTIMAL BASE PERIOD -- GROUND COMBAT 


FIRST LIEUTENANTS 

Estimator 3-Year Base 
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From Table 2, an increase is seen from both 3- to 
4-year bases and from 4- to 5-year bases in all cases except 
AGG ORIG and AGG TRANS for LTCOLS. Overall, it appears that 
a 3-year base period produces the smallest figures of merit 
for validation year one, and is therefore "optimal" for this 
aggregate and data set. 

The large values of @ for first lieutenants are 
noteworthy. They may represent the inherent variability of 
the process, or they may indicate that the attrition process 


for this aggregate is in an almost continuous state of 
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change from year to year. The reasons are unclear sat gaa 
time, and further analysis with more data is needed to 


determine whether or not this trend persists. 


TABLE 3 
DETERMINATION OF OPTIMAL BASE PERIOD -- AVIATION 
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3. Aviation 

From Table 3, it is seen that for aviators, the 
4-year base period has a higher FOM than the other two 
candidates in all cases except for AGG ORIG I1LTS, for which 
the FOM for a 4-year base length is in the middle of the 
three values. Thus, the choice for the "optimal" base period 
length centers on the 3- and 5-year candidates. For iI1LTS, 
the minimum FOM for the 5-year base is smallest for MLE, 
TSCA, JS, and LTJS, while the 3-year base is "best" for both 
of the aggregate estimators. For LTCOLS, the 5-year base has 
the smallest minimum FOM only for AGG ORIG and MLE, while 


the 3-year base excels for the other four. With six 
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Bstimators being@l’best' formboth the 3=- and 5-year base 
period lengths, an aggregate-wide analysis results in a 
stalemate. Thus, the analysis is broken down by grade, with 
the conclusions being that the "optimal" base period lengths 
are 5 years for aviation 1LTS, and 3 years for LTCOLS. 

The @ values in this table, shifting from near 1 for 
a 3- and 4-year base to around .38 for 1LTS and .7 for 
LTCOLS for the 5-year base should be noted; they indicate a 
radical change in the data. This change comes about, in 
part, because of the initiation of Aviation Officer 
Continuation Pay (AOCP) in 1981. As explained by Major 
Tucker [Ref. 1: p. 18], AOCP provides a bonus per year to 
aviation officers which in turn obligates continued service. 
The program was applied to all ranks provided the individual 
met certain active duty flight status requirements. This 
action had its desired effect on retaining aviation offi- 
cers, according to the analysis of Major Tucker [Ref. 1: p. 
re) . 

In this analysis, the effect of AOCP is that data 
from the pre-1981 era is not relevant to post-1981 data, 
thereby producing @ values of 1.0 for the 3- and 4-year 
base period lengths for aviation. This means that the esti- 
mates producing the smallest figures of merit are simply the 
prior year's empirical estimates, which makes sense when the 
base years include all pre-1981 data, as they do for the 3- 
and 4-year bases. The values of @ in the .7 range for 3 of 
the 6 estimators for lieutenant colonels and the 5-year base 


indicate that theoretically, 19°2 data should be given a 


weight of .7, 1981 data a weight of (.7)(.3) = .21, and 
1977-1980 data a collective weight of (.7)(.3)% = .09 (see 
Bouation. 2.2). This is also consistent with the AOCP 


program; the exponential smoothing model is beginning to 
-build a base of its own beginning in 1981. This is also seen 


to be happening to the 4 estimators introduced by Robinson 
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[Ref. 2] for first lieutenants; the model is constructing 
its own base. The exponential smoothing model really shows 
its flexibility and overall value in its predictions for the 


aviation aggregate. 


E. STABILITY OF THE SMOOTHING CONSTANTS 

The stability of the smoothing constants is importantaas 
the validity of the exponential smoothing model. This is 
because if the same value of & produces optimal results in 
the short run, then the exponential smoothing model is a 
good one to use. We say "in the short run" because changes 
in conditions over time that affect the data will demand 
updates in @ as well as the base period used. 

Despite the relatively short base periods forced upon us 
by a lack of data, the smoothing constants found for each 
study block appear to be rather stable, i.e., there are no 
wild fluctuations in the @ which produces the minimum trans- 
formed FOM. The few exceptions will be identified in the 
analysis that follows. The stability of the smoothing 
constaiits will be demonstrated in two ways: within base 
period lengths, and between base period lengths. 

1. Within Base Period Lengths 

The stability of @ within a base period length is 
measured by how much @ varies in producing minimum figures 
of merit for all of the validation years (VY) available. 
The analysis of the stability of @ within base period 
lengths, therefore, is restricted to the 3- and 4-year 
bases, since the 5-year base can only be validated on one 
year, 1983, in our data set. In addition, the two aggregate 
estimators are excluded from this and the following (between 
base period lengths) graphical analyses because of the 
consistently poor performance they show as compared to the 
other four estimators as measured by the figures of merit in 
transformed space seen in Tables 1, 2, and 3. An analysis 


of the stability of « for these two estimators reveals that 
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Figure 3.2 
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Figure 3.3 
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Figure 3.4 


40 





O'1-(¢9)e 
O1"(79)9 9g9°=(19)" 





NGIS-S3NVP NOLUVISNY CGQUAN 


Wid W 
ot vo v0 +0 to 0 





¥6°@(¢9)s _ ; 
O1=(Z79)9 «OR =(19)” 2 


VOSt 


O'1=(¢9)e 
O1—(Z79)9 7Z6'=(19)” 


NULLS -S3rer 






90° =(¢g)2 
96'=(Z79)9 Z'=(19)s 


aw 





1LTS 


Within 3-Year Base Stability -- Grd. Cbt. 


Figure 3.5 
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Figure 3.6 
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the AGG TRANS estimator shows perfect consistency in its 
optimal @ values in all cases, and the AGG ORIG @ values are 
also very stable in most cases with no notable exceptions. 

Note that when reading the graphs for the 3-year 
base period length, the solid line is for validation year 1, 
1981, the dotedashed line is for validation year 2, 1982, 
and the dashed line is for validation year 3, 1983. The 
graphs for the 4-year base period length have a solid line 
for validation year 1, 1982, and a dot-dashed line for vali- 
dation year 2, 1983. The year corresponding to each type of 
line is seen on one of the graphs, usually the "MLE" graph, 
on each page. 

At first glance, it would appear that these twelve 
graphs show some study cells to have very stable @ values 
while others have @ values that vary greatly. Before any 
conclusions are drawn, however, attention must be focused on 
the scales of the Y-axes. In almost all cases, these scales 
are so small that they render the curves practically flat 
over the interval covered by the range of optimal @ values. 
This indicates stability in @ despite the seen difference in 
optimal @ values since any @ value in the range of optimal @ 
values will produce a figure of merit very close to the 
optimal FOM. 

A measure of the disparity caused by the differing @ 
values is the maximum percent differential of figures of 
merit produced in the range of optimal @ values over all 
validation years. This error is measured for each valida- 
tion year, estimator, and study block by subtracting the 
minimum FOM produced in the range of @ from the the maximum 
FOM produced and then dividing by the minimum FOM. The 
maximum of these over the validation years for an estimator 
and study block is the error measure. 

For these figures, this value is generally very 


small, usually between O and 2 percent. For a 3-year base 
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period length, however, there are some estimator-study block 
combinations with errors greater than 5% (chosen arbitrarily 
to be an acceptable tolerance), and these are: 

1) aviation TETS MLE witheis52e47/ error 

2) combat support LICOLS Yaryvietn 5. 24 error 

3) combat support LICCLS Selose tes - er Lor 

4) ground combat TETS MEE Vwaehe2..7 - errer 

5) ground combat ILTS 1SCA wieiec. 0S7 error 

6) ground combat LICOLS MER waem Ss. 7s @error 
This implies that only 6 of the 24 @ values studied for the 
3-year base period may vary too much within validation years 
for that base period length. 

For a 4-year base-period length even better results 
are obtained. The maximum percent differential is the 4.2% 
posted by the James-Stein estimator for combat support I1LTS, 
which also had the largest gap in @ values, .24. In fact, 
outside of that study group, only one estimator-study block 
combination, MLE for aviation LTCOLS, has a percent differ- 
ential of more than 1.1%. Thus, Figures 3.1 to 3.12 appar- 
ently show that @ is stable within base period lengths for 
both cases we can study using the data set. 

2. Between Base Period Lengths 

The stability of a@ between base period lengths is 
measured by how much @ varies in producing minimum figures 
of merit for equivalent validation years. The analysis will 
therefore observe optimal tu for validation year 1 using a 
3-, 4-, and 5-year base period length, as well as validation 
year 2 using a 3- and 4-year base period length. 

Note that when reading the graphs for validation 
year one, the solid line is for the 3-year base, the the 
dot-dashed line is for the 4-year base and the dashed line 
is for the S-year base. The graphs for validation year two 
have a solid line for the 3-year base and a dashed line for 


the 4-year base. The year corresponding to each type of 
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line is seen on one of the graphs, usually the 'MLE' graph, 
on each page. 

A review of Figures 3.13-3.24 show mixed results for 
the stability of the smoothing constants. The aviation 
aggregate (see Figures 3.13, 3.14, 3.15, and 3.16) shows a 
large instability between base period lengths for validation 
year one and an almost perfect stability for validation year 
two. This is again explained by the initiation of the 
Pviacion Officer Continuation Pay program in 1981. The 
instability for validation year one is caused by the large 
decrease in optimal a for the 5-year base period from that 
of the other two. As discussed in the previous section, the 
5-year base contains 1981 data, so the @© value no longer has 
to be 1.0 to produce optimal figures of merit as it did in 
the 3=- and 4-year bases (which explains the stability of @ 
for validation year two). Thus, the instability of @ is 
welcome here, as it is indicating a change in the aviation 
attrition environment. 

From Figures 3.17 and 3.18, we see that @ is stable 
fois combat support  1LTS. The only exception is’ the 
James-Stein estimator for validation year two. This excep- 
tion has a percent differential of 10%, while all of the 
other cases have percent differentials well below the arbi- 
trary acceptable level of 5%. Figures 3.19 and 3.20 show 
that the opposite is true for combat support LTCOLS; only 
the MLE shows stability. The percent differentials for TSCA, 
JS, and LTJS are all above 10% for the validation year one 
case, and have surprisingly small, though unacceptable, 
values of 5.1%, 6.7%, and 5.6%, respectively, for the vali- 
dation year two case. They are "surprisingly" small because 
the ranges of optimal @ are very large, .28, .36, and .32, 
respectively, and one would think that the percent differen- 
tial would be much bigger in light of these large ranges. A 


pairwise analysis of the optimal @ values leads us to 
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believe that the optimal @ for the 3-year base is signifi- 
cantly smaller than that for the 4- and 5-year bases, for 
which @ appears stable. Thus, it would seem from this data- 
limited analysis that the optimal @ values for TSCA, JS, and 
LTJS for combat support LTCOLS is stabilizing as the later 
years are included in the base. 

Figures 3.21 and 3.22 show a very stable optimal @ 
value for all estimators in both validation year cases for 
ground combat I1LTS, except TSCA for validation year one, 
which has a percent differential of 8.1%. As mentioned in 
the previous section, the reasons for the preponderance of @ 
values of 1.0 for this study block are unknown. All that is 
known is that these large @ values indicate a very turbulent 
environment for the attrition of ground combat I1LTS, with 
the patterns changing dramatically from year to year. An 
analysis of Figures'3.23 and 3.24 shows that @ is stable for 
ground combat LTCOLS as well. The only instability seen in 
these graphs is the MLE for validation year one, which has a 
percent differential of 6.5%. Therefore, the conclusion is 


that @ is stable for the ground combat aggregate. 
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IV. RESUETS 


A. GENERAL 
This chapter displays various data results, using a 
Pemeesvcarebase period, for the six estimators used in this 


study. 


B. COMPARISON WITH RESULTS FROM EARLIER WORKS 

Table 4 thru Table 6 display the figures of merit 
obtained by using a 3-year base period and smoothing the 
empirical rate of year 4 (1980) onto it. The figures of 
merit and optimal G@ represent those corresponding to the 
minimum transformed figures of merit for validation year 2 
(1982), since it was determined earlier in this study that 
the ability to forecast two years into the future should be 
the major concern of the Marine Corps. Table 7 thru Table 9 
show the results obtained by Robinson in his thesis [Ref. 2: 
pp. 39-41]. These estimates are the same as those of a 
4-year base period with an @ value of O. In the analysis 
that follows, this estimation scheme is referred to as the 
"Robinson method" or the "Robinson estimation scheme. " 

One may notice a slight difference in the original scale 
figures of merit between Tables 7, 8, and 9 and Tables 5, 6, 
and 7 in Robinson's thesis [Ref. 2: pp. 39-41]. This is 
because a small error was found and corrected in APL func- 
tion RISKO since the submission of Robinson's thesis in 
March, 1986 (that being the necessary addition of variable 
NV on lines 17-18 of the new RISKO, seen in Figure A.8, 
which was absent from Robinson's version) [Ref. 2]. 
However, the errors resulting from this mistake in RISKO in 
Robinson's original scale figures of merit are quite small, 


and in no way invalidate the comparisons he made [Ref. 2]. 


So 


The results of using exponential smoothing are now 
presented for each of the six study blocks. The MOE for 


comparison is transformed FOM. 
TABLE 4 
EXPONENTIAL SMOOTHING AVIATION FIGURES OF MERIT 
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J.“ Avice lem 
From a comparison of Tables 4 and 7, it is seea that 
exponential smoothing outperforms the Robinson estimation 
scheme in all cases and for all validation years except the 
transformed aggregate estimator. This exception is not 


important at all, since the figures of merit for this 
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TSBES 5S 
EXPONENTIAL SMOOTHING COMBAT SUPPORT FIGURES OF MERIT 


TRANSFORMED FOM 
igs eZ LISS 


ANS 
conn 
eee 
4.0 
2.4 
ie 6 
76 
6 


HOOMNUOH RK 
mOOO0? 


4. 
8 
O 
It 
8 
= 


O00 SIN) C10 
Dodoo Got 
WNWOUTD 
WUE WOO?) 
O~IW WOO 
rh Gop 
MUU wu 
NSIUTICONOW 00 
H>WO0O Ul} 


WNWWHO 
Oost © 

HHUOONN 
MOwWnwnd.A0 
DWWWOWW 
PHN WH 
CONIONINIW 
OWNUUUI 
Mh SO) 


“JHB ND OY] GO 


fH 
WO 
OO 
oO 
OWNOMUMN NS ~0WV0100 
4 
Ww 
Co 
W 


a) 
ae: 
aS 
nO 
oe) 
ae 
RIGINA 
i 
7 
2 
O 
O 
6 
O 


4 
UNIOODN WONT MPRRrNW-H 


HWOOUOKH KK 
ROOO0? 

4 

bod 
~JO00~1 0109 00 
UOINWUTNO BS © 
IO OIG 0 
H> OOF OOF*N 
COMIOOH WO? 
OP OUINOUI 
On~19100 OVO 
HM OVUTO Pp 
NWWMOUINWH 
OF OI OVO 


WNHWWHO 
Ov 0 

1 
DODO N GB 
WNWORW 
O01 BIE 
WOR OVOm™ 
H> GOO BN 
NNWWWW 
WWF 0000 
WUTFMIOVNO 
OOW Or 
SIWDO QUT} 

4 
DONNU1WO 
SOW IWO 
GUT OY GO} 
H> (OO 010100 
NORWWO? 





estimator in all cases are so much higher than those for the 
others. This result extends into original scale, where 
exponential smoothing is again seen to have lower figures of 
merit. Special notice should be given to the exceptional 
performance of exponential smoothing in forecasting rates 
two and three years into the future as compared to the 
Robinson method. 

A major reason that exponential smoothing does so 
Svoledn thicmease is the inflexibility of the Robinson esti- 


mation scheme. His scheme cannot readily adjust to changes 
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fsan 6 
EXPONENTIAL SMOOTHING GROUND COMBAT FIGURES OF MERIT 
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in the environment such as the Aviation Officer Continuation 
Pay program initiated in 1981. This program, as has been 
mentioned before, is believed to have radically changed 
attrition patterns for aviators as compared to 1977-1980. 
The exponential smoothing model's ability to anticipate this 
change, which it does by completely eliminating the effects 
of data from years 1977-1979 by having «@ values of 1, allows 
it to better predict attrition rates for the years following 
the change in the aviation environment. Eventually, once a 


base period of post-1981 data is established, the @ values 
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TABLE 7 
POUReYEAR BASE ESTIMATE AVIATIONSFIGURES OF MERIT 


TRANSFORMED FOM 


1981 1982 1983 
Sta. 
AGG ORIG 67405 9.645 11.393 
AGG TRANS 197.621 2022-0272 208. 808 
MLE 3.914 9.981 TO. 470 
TSCA Cao 9.574 10,042 
JS Sov Ss 9.768 ike), Sues! 
emis Bi 642 9.764 LO077279 
PLecOL 
AGG ORIG 9.957 17.997 15. 488 
AGG TRANS 25.093 29.506 29.310 
MLE 4.366 9.058 Sea 
TSCA 5.99 / 10. 967 10.394 
aS 5. fo LO.gae 1O~e 55 
LTJS 5.744 LO. S90) 10. 340 
ORIGINAL F 
1981 1982 1983 
ise jingh 
AGG ORIG 31.499 34.924 54.911 
AGG TRANS 321.894 286. 068 BIZ. eoO 
MLE 22.804 46.751 574 
TSCA oss 3 38.458 49.389 
JS 21.144 39.596 51 On3 
EJs DOs 32 39.434 50. 690 
LTCOL 
AGG ORIG 74.697 ale, 93 512256 
AGG TRANS 230505662 248.171 3900. 284 
MLE S32 SZ 55.925 Ze © 
TSCA 37.974 57.475 378 7 
aS 56. 7Cc 54> 901 Gre 2 1s 
LTJS S721S8o0 Soe 35.619 


should decrease substantially, thereby giving the base esti- 
mate some meaning in the estimation of the attrition rates. 
Further study into this matter should be undertaken as more 
data becomes available. 
pee 6 COMbal SUDDOrt 
From a comparison of tables 5 and 8, one sees that 
in all cases for combat support I1LTS, the Robinson method 
figures of merit are slightly smaller than those produced by 
exponential smoothing. The values of @ vary widely over the 


Six estimators. Notice that maximum likelihood estimation 
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FOUR-YEAR BASE BS Ee SUPP@RT FIGURES OF 
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produces alarmingly high figures of merit in the original 
scale. This is a direct result of the unsuitability of using 
the optimal « for transformed scale to predict original 
scale rates discussed in Chapter 3 (see also ApSbend7 ae 
Additionally, its figures of merit in transformed scale are 
higher than those for all but one of the other estimators, 
so it appears that MLE is not a very good alternative to use 
for this study block. 
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TABLE 9 
FOUR-YEAR BASE ESTIMATE GROUND COMBAT FIGURES OF MERIT 
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Comparing Tables 5 and 8 for lieutenant colonels, we 
see that the Robinson method's estimates are barely better 
than the exponential smoothing estimates in all cases. The 
values of @ producing the minimum figures of merit for 1982 
range from .26 to .38 over the 4 estimators introduced by 
Robinson [Ref. 2]. However, as one can see from Figure 3.4, 
the curves are flat enough in this range that choosing any @ 
in this range would produce good results. 

Exponential smoothing, therefore, proves to be an 


good technique for predicting attrition rates for the combat 


ial 


support aggregate. Its forecasting ability is almost as good 
as Robinson's method while requiring far less data. 
3. Ground Combat 

A comparison of Tables 6 and 9 shows that exponen- 
tial smoothing outperforms the Robinson method's estimates 
in most cases for the ground combat aggregate. For iijms, 
exponential smoothing is better in all cases except for the 
aggregate estimators. The improvement over the Robinson 
method figures of merit is almost 50% for validation year 
1982 for MLE, TSCA, JS, and LTJS, and is also quite notice- 
able for the other two validation years. Again, the reasons 
for the @ values near or at 1.0 are unknown, but they indi- 
cate a radical change in the attrition environment for 
ground combat I1LTS. Further study is needed to determine 
whether or not this turbulence is specific to our data. But 
whatever causes this apparent yearly change in attrition 
patterns, the exponential smoothing model shows its efficacy 
as a forecasting model in this study block by anticipating 
this change and discounting the now-irrelevant base period 
data, with the result being significant improvements in 
forecasting ability over the methods of Robinson. 

For ground combat LTCOLS, The AGG ORIG, TSCA, JS, 
and LTJS estimators using exponential smoothing have smaller 
figures of merit than the Robinson estimation scheme, and 
the figures of merit for AGG TRANS and MLE are slightly 
higher for exponential smoothing than for the Robinson 
method. However, the differences are small in both direc- 
tions; they are not nearly as pronounced for this study 
block as they are for combat support ILTS. These results 
hold for all three validation years. Again, we see the expo- 
nential smoothing model producing attrition rates as good 
as, if not better than, a method which theoretically 
requires much more data. This study block, then, also shows 
exponential smoothing to be a good model to perform the 


ACTYrition race calculations. 


TZ 


eee nl PRT. TON RATES 

The attrition rates for all 7 operational fields for 
first lieutenants and lieutenant colonels are presented in 
Tables 10 thru 23. Attrition rates are computed for all 6 
estimators and all 31 lengths of service. 

Unlike the estimates produced by Robinson for the orig- 
inal aggregate [Ref. 2: pp. 54-67], those calculated by 
exponential smoothing are not the same for all cells with 
non-zero rates, except when g=0, as is the case with combat 
support LTCOLS. They would be the same were the smoothing 
done in original scale, but since it is done in transformed 
scale, variability is introduced. This is because taking the 
average of two sets of data in transformed scale, linearly 
combining them using Equation 2.1, and then transforming 
back to original scale will not produce a single average for 
all cells as would linearly combining two original scale 
average rates. This is basically the same reason that there 


1S variability in the transformed aggregate estimates. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 

This study investigated the ability of the exponential 
smoothing model to update attrition rates for Marine Corps 
manpower models from year to year. Its value as a yearly 
updating scheme has been demonstrated in this work. 

For the reader who wants a single general purpose value 
of a, we offer the value @ = .4, but do so reluctantly. 
Brown has suggested using an @ between .01 and .3 in the 
applications he Ystudied [Ref 36-7) sens lOc Our work, 
involving manpower attrition rates, appears to call for 
larger values. However, we have identified some special 
Situations for which the smoothing constant should be 
considerably larger, e.g., aviation LICOLS and I1LTIS with a 
pre-1981 base forecasting post-1981 rates. 

Exponential smoothing produced estimates for the combat 
support and ground combat aggregates that were, more often 
than not, better than those produced by the methods of Major 
Robinson [Ref. 2], without needing, in theory, the massive 
data files his methods use to produce the attrition rate 
estimates. The exponential smoothing model reflected the 
change in the aviation environment that occurred in 1981 and 
easily outperformed the Robinson method's estimates in this 
aggregate for the years following because of the inflexi- 
bility of the Robinson method. It also anticipated an 
unknown source of turbulence in the ground combat first 
lieutenant attrition rates, and bested the estimates of 
Robinson's methods for this study block. 

Also seen in this study was that three of the four esti- 
mators presented by Robinson [Ref. 2], transformed cell 
eae average, James-Stein, and limited translation 


James-Stein, outperform the current method used by the 
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Marine Corps when exponential smoothing is used in all vali- 
dation years and study blocks except validation years 2 and 
3 for combat support I1LTS. These two exceptions, however, 
were also the only ones seen in Robinson's thesis [Ref. 2: 
p. 40]. Unfortunately, none of these three emerges as the 
clear-cut "best" estimator in this study, but all are better 
than the current Marine Corps estimator... 

The maximum likelihood estimator shows the same good 
performance in transformed scale in this study as it did in 
Robinson's [Ref. 2: pp. 39-41]. However, there are more 
cases of large original scale figures of merit for MLE in 
the present work than were seen previously (see Tables 4-9). 
These extraordinarily large figures are seen for the ground 
combat aggregate for both grades and for combat support 
1LTS. Not coincidentally, these are the same study blocks 
for which the use of the optimal @ for transformed scale to 
produce original scale estimates was determined to be unsui- 
table in the analysis of Appendix C. The ability of the MLE 
to produce attrition rates better than those of aggregate 
estimators for the other three study blocks indicates that 
it, too, may be better than the aggregate methods currently 
in use, and warrants further study into the cause of the 
problems in original scale just mentioned. Perhaps if 
smoothing is done in original scale rather than transformed 
scale, the optimal properties of MLE will be better 
displayed. 

Thus, Robinson's conclusion [Ref. 2: p. 68] that the 
MLE, TSCA, JS, and LTJS estimators should be given serious 
consideration for replacing the Marine Corps’ current scheme 


is reiterated in this work. 


B. RECOMMENDATIONS 
Despite the encouraging results produced herein, it is 
not recommended at this time that either exponential 


smoothing nor any of the four promising estimators presented 
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as 


alternatives to the current method be implemented. 


Further study is needed in the following areas: 


i 


Base Period. The problem of anticipating REO e changes 
in Marine Corps policy such as _ the one that the avia- 
tion OF underwent in 1981 and their "effects onm@ene 
length of the base period should be studied. Also, as 
more data becomes available, more analyses like the 
ones conducted herein to determine optimal base period 
length should be conducted to produce stronger conclu- 
sions about base period length. 


Aviation. As more data is obtained the aviation 
aggregate should be re-examined and 9 used as the 
first base year to see if lower values of @ can be 
produced, indicating a consisteney from yeau Seomyea. 
aa ae loss rates which did not exist from 197 7mmee 


Ground Combat 1LTS. The reasons behind the values of @ 
being 1.0, which indicate a year-to-year chan in 
attrition patterns for this study block, shouwlamee 
investigated. Despite the excellent results achieved 
with respect to the low figures of merit produced yea 
ersistence of such @ values would indicate that the 
ase period is totally unimportant, thereby making the 
use of exponential smoothing une ecee sy. The issue 
is, therefore, whether or not the @ values seen for 
ground combat 1LTS herein are the product of a 
eculiar set of data. A new analysis of Chis oer 
lock should be undertaken using years other than 
1977-1979 as the base period as soom as enouwgineaaea 
becomes available to perform validations on newly 
produced attrition rates. 


Maximum Likelihood Estimation. In light of the prom- 
ising performance seen for this estimator in esas 
formed scale using exponential smoothing an 
investigation of the unsuitability of using trans- 
formed optimal @ values to produce original scale loss 
rates seen for certain study blocks is needed. 


Aggregation. As recommended by Major Robinson [Ref. 2: 
: 69} the work of Amin Elseramegy [Ref. 5], who used 
he CART routine to find aggregations with encouragin 

results, should be investigated. Also, the work o 

Major Tucker [Ref. 1: pp. 5-84], which demonstrated 

increased attrition at certain lengths of service for 

certain grades, should be followed up by attempting To 
aggregate by LOS instead of OF to see if the results 
can be improved. 
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APPENDIX A 
FUNCTIONS USED IN CALCULATIONS 


The following APL functions, and ones similar to then, 
are used in this study to produce the figures of merit and 
attrition rates seen in the tables in Chapters III and IV. 
These procedures require that the following variables be 


global, i.e., defined throughout the workspace: 


(1) N = the estimation period central inventory array, 
e.g., ; 

(2) Y = the estimation period loss array, e.g., YA5, 

(3) VN = the validation period centarl inventory array, 
e.g., VNAS, 


(4) VY = the validation period loss array, e.g., VYA5, 


(5) AN = the estimation period average inventory array, 
e.g., ANAS, 


(6) G = the forced James-Stein shrinkage rate, and 


(7) DEE = the factor used in limited translation 
James-Stein shrinkage. 


Functions like A5B seen herein set the values of all of 
these parameters except G, which is set in the workspace 
itself to O. 

In order to create the arrays of figures of merit for @ 
values between O and 1 for a three-year base period, APL 
function ALPHAHAT is called (see Figure A.1). ALPHAHAT calls 
A5B in Figure A.2 to produce the 3-year base estimates from 
years 1977-1979 and the empirical estimates for 1980. To do 
this, A5B sets the values of the global variables, then 
calls ESTIM, seen in Figure A.3, to produce the base esti- 
mates. ESTIM, in turn, calls BINPREP in Figure A.4, SUMSQ in 
Figure A.5, and MLE in Figure A.6 in performing its calcula- 
tions. A5B then calls XFOUR in Figure A.7 which resets the 
global variables N, Y, and AN, and calls ESTIM to produce 


the empirical transformed attrition figures. Notice that the 


eal 


V ALPHAHAT;LB;UB;STEP; RATES Mas -ALPHA:NUMSTEPS 
a THIS FUNCTION WILL FIND vanake OF THE RISK 
a FUNCTION IN BOTH TRANSFORNED AND ORIGINAL SPACE 
a FOR VARYING VALUES OF ALPHA BETWEEN ANY TWO 

a LIMITS SET BY THE USER. 

a' INPUT LOWER BOUND' 


LB<0 
a't INPUT UPPER BOUND ' 


UB<1 
at INPUT STEPSIZE'! 

STEP<0.02 

ALPHA<LB 

NUMSTEPS<1+(UB-LB)+STEP 

a INITIALIZE ARRAYS OR1-OR6 AND TR1-TR6, WHICH 
n ARE THE ARRAYS OF FOM'S FOR ALPHAS BETWEEN 
a LB AND UB BY STEPSIZE STEP. VALUES 1-6 

Q CORRESPOND TO AGG ORIG, AGG TRANS, MLE, 

a TSCA, JS, AND LTJS, RESPECTIVELY. 

oi <GkoOhs <OnucoRS tone (NONSTERS SAA BUN} Yo 00 
TR1<TR2<TR3<TRU<TR5<TRE<«(NUMSTEPS, (1+0VN))p0 


cm 
Qa CALL A5B_ TO OBTAIN BASE ESTIMATE S3 AND 
A EMPIRICAL ESTIMATE S43 


A5B 
QA HERE IS THE EXPONENTIAL SMOOTHING FUNCTION 
NEXT: R« (ALPHAxX4 )+(S3x(1-ALPHA )) 

A CALL RISKO AND RISKT AND PLACE THE RESULTS 

A econo ALPHA VALUE IN THE OR AND TR ARRAYS 


RISER. 
M2<1 


M2<M2+4 

>ONEX 1 (M282 ) 
NEWSTEP: ALPHA*ALPHA+STEP 
M1<M1+1 

*HEXDX1 (ALPHASUB) 
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Figure A.l APL Function ALE RAAT 


James-Stein shrinkage factors calculated for the base esti- 
mates and the DEE values used in limited translation 
James-Stein for the base estimates are also used for the 


empirical estimates. ALPHAHAT then smooths the empirical 


OZ 


a CALL eee ae PRODUCE THE EMPIRICAL RATES 
a X4 FOR 198 
XFOUR 


G<0 
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Figure A.2 APEeBunctlonsAss 


estimates onto the base estimates and calls RISKO in Figure 
A.8 and RISKT in Figure A.9 to provide the figures of merit. 
RISKO calls BINCONV in Figure A.10 to produce original scale 
loss rates using the inverse arcsine transformation seen in 
Appendix B for use in the chi-square FOM formula. The 
resulting arrays, which provide figures of merit for all 
estimates and for all validation years, can be analyzed to 
find the a@ values which minimize transform FOM. 

The above example would find the figures of merit for a 
3-year base period for aviation I1ILTS. In order to obtain the 
figures of merit for the other five study cells, functions 
much like ASB are created to set the global variables equal 
to their respective loss and inventory figures. To make 
these calculations for 4- and 5S-year base period lengths, 
functions called XFIVE and XSIX are written. These functions 
are the same as XFOUR except that XFIVE finds the empirical 
rates for 1981 and XSIX does so for 1982. The A5B-type func- 
tions are also changed accordingly to alter the number of 


years used to calculate the base estimates. 
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TSCA (TRANSFORMED), JAMES-S ND 
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EACH PAGE OF THE R ARRAY IS A SEPARATE 
ESTINATE. THE DEE VALUES USED HEREIN 
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Figure A. 4 APL Punectlonep eens. 


Finally, in order to produce the original scale esti- 


mates, the A5B-type functions are modified to perform the 
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V X<SUMS 
a Meo Lares TH PRE SSE AND SSB FOR 2. ALSO 
a CALCULATES THE MLE (ZB) AND _CRAND MEAN 
a OR AGGREGATE (ZBB), BOTH DIRECTLY FROM 
a TRANSFORMED DATA. 
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Figure A.5 AEG FPunGelon SUMS 
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Figure A.6 APL Function MLE 
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Figure A. 7 APL Function XFOUR 


smoothing operation with the @ values fixed at their optimal 


levels for each of the six estimators to produce the 
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Figure A. 8 APL FPuUNnCElOny e510 


smoothed transformed figures. Function BINCONV in Figure 
A.10 is then called, which inverts the transformation and 
yields the original scale attrition rate estimates seen in 
Tables 1OeGhrue Zs 
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V RISKT:13D:2 
COMPUTES THE SCALED RISK. VY AND _VN_ ARE THE 
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Figure A.9 PPL Punection RISKT 


VY BINCONV:V0;:V1:N1;D 
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VALIDATION YEAR LOSSES AND INVENTORY. VN, VY, 


APEERE Ls 
FREEMAN-TUKEY ARCSINE TRANSFORMATION 


1. GENERAL 

Because the TSCA, James-Stein and limited translation 
James-Stein techniques make the assumptions that the distri- 
bution of the number of losses is normally distributed with 
constant variance, and because the binomial model for the 
loss data does not meet these assumptions, a transformation 
is needed. The Freeman-Tukey arcsine transformation produces 
values for which normality and constant variance become more 
tenable assumptions. 

Robinson demonstrated in his thesis [Ref. 2: pp. 74-79] 
that both the normality and variance assumptions are compro- 
mised somewhat for low values of n and p. He therefore 
concluded that the Freeman-Tukey transform is unreliable at 
such values. Therefore, the validity of the results for 
James-Stein estimation and limited translation James-Stein 
must be questioned in this analysis as they were in 
Robinson's [Ref. 2: p.19]. The following two equations are 
represented in APL by functions BINPREP (transform) and 
BINCONV (inverse transform). See Appendix A. 


2. THE TRANSFORMATION 
The equation for the transformation is: 
x = 0.5(nt+0.5)1/4% sin7l( 2y/(n+1)-1) (B.1) 
+ sin7}(2( y+1)/(n+1)-1) 


This equation transforms raw losses, y, into transformed 


losses, x using the central inventory, n. 
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3. THE INVERSE TRANSFORMATION 
To invert the transformation and produce the rates in 


original space, use the following set of equations: 


aia s aa) Ge) ecoeme ee (B. 2) 
0 Viz: le. -1/2 (B. 4) 
E> ~SCitsin Vigl%)) ain “N/2<6V 55 <T/2 
1 Vij: Ge-N/2 
where ni 5 is the central inventory for the ith Los and the 
jth Ok, Xi 5 is the corresponding transformed attrition 
figure, and Vij the corresponding loss rate estimates in the 


Original scale. 
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APPENDIX C 
ANALYSIS OF OPTIMAL ALPHA OF TRANSFORMED AND ORIGINAL SCALES 


1. GENERAL 

The following tables give the optimal values of @ for 
transformed and original scales for the three-year base 
period used in the production of the attrition rate esti- 
mates in Chapter IV. The values of @ listed are those which 
produce the minimum figures of merit for validation year 2, 
LOZ. 

As one can see from the comparison tables, the @ values 
producing the minimum figures of merit for transformed scale 
are very close in most cases to the @ values producing the 
minimum figures of merit for original scale, with the 
notable exceptions being MLE for combat support and ground 


combat. Each of the aggregates is discussed below. 


TABLE 24 


COMPARISON OF TRANSFORMED AND ORIGINAL ALPHA 
AVIATION AGGREGATE 


TS TRANSFORMED @ ORIGINAL @ 
AGG ORIG oo OO 

AGG TRANS 200 

MLE 00 

foc. woo 


OO 


JS : 
LTJS . OO 


LTCOLS TRANSFORMED @ ORIGINAL @ 
AGG ORIG 1. O00 O00 
AGG TRANS Le: lt. 
MLE : : 
ISCA 1 
JS il 


ETS ils 


Note: Optimal @ values are for validation year 1982. 
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2. AVIATION 

Looking at Table 24, one sees that for aviation, the @ 
values match up almost perfectly except for the transformed 
aggregate for I1LTS, which has values at completely opposite 
ends of the limits of «@ for the two scales. However, since 
the aggregate transform estimator shows very poor perform- 
ance throughout the analyses in Chapters III and IV, with 
much larger figures of merit than the other estimators, 


inconsistencies like this are not of much concern. 


TABLE 25 


COMPARISON OF TRANSFORMED AND ORIGINAL ALPHA 
COMBAT SUPPORT AGGREGATE 


LLTS TRANSFORMED @ O 
AGG ORIG Poe 
AGG TRANS OO 
MLE 
ISCA 
JS 
LTJS 
LTCOLS TRANSE 
AGG ORIG : 
AGG TRANS as 
MLE 
TSCA 
JS 
LTJS 


Note: Optimal @ values are for validation year 1982. 
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sae COMEBAL SUPPORT 

From an analysis of Table 25, one sees that the combat 
support aggregate likewise shows a consistency in the values 
of a@ for transformed and original scales. The only excep- 
tions to this are MLE for 1LTS, which has a difference in @ 
values of a whopping .44, and, to a much lesser extent, TSCA 
for 1LTS and JS for LTCOLS, which each have a difference in 


@ values of .10. 
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TABLE © 


COMPARISON OF TRANSFORMED AND ORIGINAL ALPHA 
GROUND COMBAT AGGREGATE 


eS TRANSFORMED @ 
AGG ORIG sae) 
AGG TRANS 
MLE 
Ses 
JS 


LTJS 
LTCOLS 

AGG ORIG 

AGG TRANS 

MLE 

ISCA 

JS 

LTJS 


Note: Optimal @ values are for validation year 1982. 
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4. GROUND COMBAT 

The ground combat aggregate also shows consistency 
between optimal values of @ in transformed and original 
scales for all estimators except MLE for both grades and AGG 
TRANS £O27ee2 21S: The lack of consistency between the @ 
values for transformed and original scales for MLE seen in 
Table 26 as well as in the I1LTS section of Table 25 is of 
Major concern. Unfortunately, using the transformed optimal 
@ value to produce figures of merit in the original scale 
for MLE has a big effect on those figures, making them much 
larger. This casts into doubt the ability of the exponen- 
tial smoothing model to produce good maximum likelihood 


estimates of attrition rates. 
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